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Abstract 

Consider an operator equation (*) B{u) — / = in a real Hilbert 
space. Let us call this equation ill-posed if the operator B'{u) is not 
boundedly invertible, and well-posed otherwise. The DSM (dynamical 
systems method) for solving equation {*) consists of a construction of a 
Cauchy problem, which has the following properties: 1) it has a global 
solution for an arbitrary initial data, 2) this solution tends to a limit as 
time tends to infinity, 3) the limit is the minimal-norm solution to the 
equation B{u) = f. 

A global convergence theorem is proved for DSM for equation (*) 
with monotone Cf^^ operators B. 



1 Introduction 

In this paper the dynamical systems method, DSM, (see [1]) is proposed for 
solving nonhnear operator equation of the form: 

B{u)-f = 0, feH. (1.1) 

We make the following assumptions: 

A) B is a monotone, nonlinear, Cf^^ operator in a real Hilbert space H , i.e, 
suPnGe(uo,R) 1 1-^^''^'")! I ^ Mj{R) := Mj, j = 0, 1,2, where R > is arbitrary, 
B{uq,R) := {u : \\u — uq\\ < R}, B^^\u) is the Frechet derivative. The set 
N := {z : B{z) — / = 0} is non-empty, and y £ N is its minimal-norm 
element. 
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It is known that N is convex and closed if B is monotone and hemi- 
continuous, and such N & H contains the unique minimal-norm element y: 
B{y)-f = 0, \\y\\<\\z\\,\fzeN. 

Let u denote the derivative with respect to time. Consider the dynamical 
system ( that is, the Cauchy problem ): 

u = $(u), u(0) = uo; ^ ■.= -A-^[B{u) + eu- f], (1.2) 

where u := Ug{t), := A + el, A := B'{u), I is the identity operator, e > 
is a number, the prime stands for the Frcchet derivative, and $(it) is locally 
Lipschitz if the assumption A) holds. Thus, problem (1.2) has a unique local 
solution. 

The DSM in this paper consists of solving equation (1.1) by solving (1.2), 
and proving that for any initial approximation uq the following results (1.3) 
and (1-4) hold: 

3u(t)Vt > 0, 3Ve := u{oo) := lim u{t), B{Ve) + eK - / = 0, (1.3) 

t— >oo 

and 

lim ||V; - y|| = 0. (1.4) 

Conclusion (1.4) is known, but we give a simple proof in Section 2 for conve- 
nience of the reader. Denote 

:=-21og(e). (1.5) 

We prove: 

lim \\ue{te) -y\\=0. (1.6) 

e— »0 

Problem (1.1) with noisy data fs, — /|| < S, given in place of /, generates 
the problem: 

ws = ^siws), ws{0) = no, (1.7) 

and is similar to $ in (1.2) with fg and ws replacing / and u, respectively. 
We prove that, for a suitable choice of e{S) and ts, the solution ws to (1.7), 
calculated at a suitable stopping time t = ts := te(5), converges to y: 

lim\\wsits)-y\\ = 0, (1.8) 

0— »0 

where e{S) > 0, liuis^oelS) = 0, and the choice of ts with property (1.8) is 
called the stopping rule. Thus, calculating the solution to (1-7) at a suitable 
stopping time ts yields a stable approximation to the minimal-norm solution 
y of equation (1.1) in the sense (1.8). 

We do not restrict the growth of nonlinearity at infinity and do not assume 
that the initial approximation uq is close to the solution y in any sense. 
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Usually convergence theorems for Newton-type methods for solving non- 
linear equation (1.1), even in the well-posed case, have the assumption that 
the initial data uq is close to y. We obtain a global convergence result for a 
continuous regularized Newton-type method (1.2). In Section 2 the results are 
stated and proved, and in Section 3 a convergent iterative process for solving 

(1.1) is constructed. In [1] other versions of DSM are presented. See also [2]. 

2 Statement and Proof of the Results 

Theorem 2.1. If A) holds, then, for any choice ofuo, relations (1.3), (1-4) j 
and (1.6) hold. Ifws{t) solves (1.7), then there is a ts such that (1.8) holds. 

Proof of Theorem 2.1. Let \\B{u) + eu — f\\ := g{t), u = u^{t). Using 

(1.2) , one gets gg = -g^, so g(t) = 5oexp(-i), where g^ := ^(0). This and 

(1.2) imply < 50^"^ exp(— t), because < e^-*-. Therefore u (00) := 
does exist by the Cauchy criterion, one has: 

||u(t)-K|| <5oe~'exp(-t), (2.1) 

and the last equation in (1.3) holds. Using (1.5) and (2.1), one gets 

IKie)-K|| <5oe- (2.2) 

To prove (1.4), use (1.1) and write equation (1.3) as B{y^ - B{y) + eVe = 0, 
multiply hy Vf — y, use the monotonicity of B, and get 

{Ve,Ve-y)<0. (2.3) 

Thus, IlKll < llyll- Consequently, ^ v, as e ^ 0, where v is some element 
and — ^ stands for weak convergence. Since monotone hemicontinuous opera- 
tors are u;— closed, that is, Ve ^ v and B{Ve) + eVe f imply B{v) + ev = f, 
and since the inequality ||V^|| < ||y|| implies ||?;|| < liminf^^o ll^ll ^ WuW^ 
concludes that v is the minimal norm solution to (1.1), sov = y. To prove that 
Ve — ^ y, where denotes the strong convergence in H, one uses inequality 

(2.3) in the form 

{V,-y,Ve-y)<{y,y-V,), (2.4) 

and the weak convergence of to y. This yields statement (1.4). 
Relation (1.6) follows from (1.4) and (2.2). Indeed: 

\\ue{t,) -y\\< \\uSe) -Ve\\ + \\V,-y\\^0, e ^ 0. 

Let us prove (1.8). As above (cf (2.1)-(2.2)), one proves 

\\ws{t) - WsW < gose-^exp{-t), \\ws{te) - Ws\\ < gose, (2.5) 
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where 505 := \\B{uo) + euo- fsW, and Ws := Wse := '^^(oo) = liuit^^wsit). In 
general, fs is not in the range of B, and Ws eioo) does not converge as e — > 0, 
6 > being fixed. One can use (2.2) to prove that there is an e := e{6) 
as (5 — 0, such that (1.8) holds. Indeed, Ws := Wse solves the equation: 

BiWs) + eWs -fs = 0. (2.6) 

Subtract from (2.6) equation (1.3), denote Ws — K := ips ■= ipSe, fs — f '■ = 
hs, \\hs\\ < S, multiply the resulting equation by ips, and use the monotonicity 
of B to get e{'iljs,ips) < SWipsW, so 

\\Ws- Veil <5e-\ (2.7) 

Let us assume: 

lim 6e-^ = 0, lim e(^) = 0. (2.8) 
<5-*0 5->0 

For example, one may take e = (5^, < 6 < 1. If (2.8) holds, then 

lhn\\Ws-V,^S)\\ = 0. (2.9) 

Prom (2.5),(2.7)-(2.9), and (1.4), one gets (1.8). □ 

Remark 2.2. Using a different argument, the author has recently proved 

(see [2]), that u,^t){t) G 13{uo,R), R := 3(||no|| + ||y||), 13{uo,R) := {u : 
ll^t ~ ^o|| ^ R}, for any initial approximation uq and a suitable choice of e{t). 



3 Convergent Iterative Process 

In this section it is proved that for a suitable choice of /i„ > and e„ > 
0, lim„_+oo e„ = 0, the iterative process: 

Un+l =Un- hn[A{Un) + e„]"^[B(u„) + - /], (3.1) 

where uq is arbitrary, converges to y, the minimal norm solution of (1.1), 
provided assumptions A) from Section 1 hold. In particular, hn can be a fixed 
positive constant, suitably chosen. A possible choice of hn and e„ is made in 
the proof of Theorem 3.1 

Theorem 3.1. One can choose e„ and hn so that 

lim \\un-y\\= 0, (3.2) 

n— >oo 

where y is the minimal norm solution to (l-l)- 
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Proof. Let F„ := T4„ solve the equation: 

B{Vn) + enVn - / = 0, > 0, lim en = 0. (3.3) 

n^oo 

Since B G Cf^^ is monotone, equation (3.3) has a unique solution for any 
f G H. Denote Zn ■= Un — Vn, and \\zn\\ ■= gn- Then, by the triangle 
inequality, one gets: 

ll^^n - J/ll < \\Un - ^nll + ll^n - y|| = ||^n|| + ll^n " y||- (3.4) 

In Section 2 we have proved that 

lim UK- y| 1 = 0. (3.5) 

n — ^oo 

Therefore Theorem 3.1 is proved if one proves that: 

lim Ibnll =0- (3-6) 

n— >c» 

Let us prove (3.6). Let 

hn ■■= \\Vn+l - VnW, Hm bn = 0. (3.7) 

n^oo 

Rewrite (3.1) as 

Zn+l = (1 - K)Zn - hn[A{Un) + enY^K{Zn) - (K+l - K), (3.8) 

where we have used the Taylor formula: 

B{Un) + enUn - f = B{Un) - B{Vn) + enZn = [A{Un) + en]Zn + K{Zn), (3.9) 

with 

\\K{zn)\\<0.5M2\\zn\\^ ■.= cgl, c:=0.5M2. (3.10) 
Prom (3.10) and (3.8) one gets: 

ch 

gn+l<{l-hn)9n + —9n + bn, < /i„ < 1. (3.11) 

Let 

e„ = 2cgn. (3.12) 

Then (3.11) can be written as: 

gn+i < (1 - an)gn + bn, < On := 0.5/l„ < 0.5. (3.13) 
Theorem 3.1 follows now from lemma 3.2: 



Lemma 3.2. Ifb^ > 0, limfe^co ^fe = 0, < a„ < 0.5, and 

oo n— 1 

V On = OO, lim V fefcc" S^^fc+i = 0, (3.14) 

n=l k=l 

then (3.13) implies 

lim gn = 0. (3.15) 

n— »oo 

Proof of lemma 3.2. From (3.13) by induction one gets: 

n— 1 n n 

fc=l j=fe+l j=l 
If a > 0, then 1 - a < e"". Thus, 

n 

n (!-%)< e" ^^=^+1 < < 1. (3.17) 

j=k+l 

The assumptions of lemma 3.2 and formulas (3.16) and (3.17) imply (3.15). □ 

In conclusion note that an, and therefore hn = 2a„, can always be chosen 
so that (3.14) hold. 

For example, one can choose aj = log pj = logp, 1 < p < \fe. This choice 
corresponds to the choice of constant hn := h := 2 logp. Then e ^j=fc+i ^ = 

Ek=l 6fce-S"-'=+i«^- = Efc=l b,p-+\ and 
lim„_»oo I]fc=i hP~'^^'^ = provided that limfe_oo 6fe = 0. □ 
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